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Abstract 

A Semi-supervised Segmentation Fusion algorithm is proposed using consensus and distributed learning. The 
aim of Unsupervised Segmentation Fusion (USF) is to achieve a consensus among different segmentation outputs 
obtained from different segmentation algorithms by computing an approximate solution to the NP problem with less 
computational complexity. Semi-supervision is incorporated in USF using a new algorithm called Semi-supervised 
Segmentation Fusion (SSSF). In SSSF, side information about the co-occurrence of pixels in the same or different 
segments is formulated as the constraints of a convex optimization problem. The results of the experiments employed 
on artificial and real-world benchmark multi-spectral and aerial images show that the proposed algorithms perform 
better than the individual state-of-the art segmentation algorithms. 
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I. Introduction 

Image segmentation is one of the most important, yet unsolved problems in computer vision and image 
processing. Various segmentation algorithms studied in the literature have been applied to segment the 
objects in images 0, ifT^ . However, there are two main challenges of their employment. 

The first challenge is to extract a robust structure, e.g. shape, of the segments by analyzing the outputs of 
segmentation algorithms when a target segmentation is not available with a training dataset. This challenge 
has been studied as a segmentation mining problem and analyzed as a consensus segmentation problem 
ifTOll . [fT^ using an Unsupervised Segmentation Fusion approach by Ozay et al. ifTdl . The second challenge 
is the selection of an appropriate algorithm with its parameters that provides an optimal segmentation 
which is closer to a target segmentation if a target segmentation is available with a training dataset. For this 
purpose, some of the segments in the segmentation set are expected to represent acquired target objects in 
the Unsupervised Segmentation Fusion algorithms ifTOll . ifTdll . |[T^ . In order to relax this assumption, first 
the error and distance functions of the algorithm should be refined to include these requirements. Therefore, 
prior information on the statistical properties of the datasets need to be incorporated using supervision. Then, 
side information about a target segmentation output should be used in the unsupervised segmentation fusion 
algorithm, which leads to a semi-supervised algorithm. In this work, this challenge has been analyzed by 
Semi-supervised Segmentation Fusion which incorporates prior and side information obtained from training 
datasets and expert knowledge to the USF algorithm ifTdll . 

Consensus segmentation problem is re-formalized as a semi-supervised segmentation fusion problem 
and studied using decision fusion approaches (111 with semi-supervised learning O. For this purpose, an 
algorithm called Semi-supervised Segmentation Fusion (SSSF) is introduced for fusing the segmentation 


outputs (decisions) of base-layer segmentation algorithms by incorporating the prior information about 
the data statistics and side-information about the content into the USF algorithm lfT4ll . In the SSSF, 
this is accomplished by extracting the available side information about the targets, such as defining the 
memberships of pixels for the segments which represent a specific target in images. For this purpose, the 
side information about the pixel-wise relationships is reformulated and incorporated with a set of constraints 
in the segmentation fusion problem. In addition, a new distance function is defined for the Semi-supervised 
Segmentation Fusion by assigning weights to each segmentation. 

In order to compute the optimal weights, the median partition (segmentation) problem is converted 
into a convex optimization problem. The side information which represents the pixel-wise segmentation 
membership relations defined by must-link and cannot-link constraints are incorporated in an optimization 
problem and in the structure of distance functions. Moreover, sparsity of the weights are used in the 
optimization problem for segmentation (decision) selection. Various weighted cluster aggregation methods 
have been used in the literature lfT3]l . Il20l . Unlike these methods, the proposed approach and the algorithms 
enable learning both the structure of the distance function, the pixel-wise relationships and the contributions 
of the decisions of the segmentation algorithms from the data by solving a single optimization problem 
using semi-supervision. 

In the next section, a brief overview of USF algorithm is given. Semi-supervised Segmentation Fusion 
algorithm is introduced in Section [Till Experimental analyses of the algorithms are given in Section |IVl 
Section |V] concludes the paper. 

II. Unsupervised Segmentation Fusion 

In the unsupervised segmentation fusion problem lfT4l . an image I is fed to J different base-layer 
segmentation algorithms SAj, j = 1,2,..., J. Each segmentation algorithm is employed on I to obtain a 
set of segmentation outputs Sj = where s, e is a segmentation (partition) output, A is the set 

of segment labels (names) with N pixels, |v4| = C different segment labels, and a distance function d{- ,■). 
Note that A^ is the class of all segmentations of finite sets with C different segment labels in the image I. 

J J 

An initial segmentation s is selected from the segmentation set S' = U Sj consisting of K = Y, 

_ i=i 

segmentations using algorithms which employ search heuristics, such as Best of K (BOK) [fllll . Then, a 
consensus segmentation s is computed by solving the following optimization problem: 

K 

s = argmin 

^ i=l 

Given two segmentations Sj and Sj, the distance function is defined as the Symmetric Distance Function 
(SDD) given by d{si,Sj) = Aqi + -^io> where Aqi is the number of pairs co-segmented in s, but not in Sj, 
and Vio is the number of pairs co-segmented in Sj but not in Si ifTTI . 

This optimization problem was solved by Ozay et al. lfT4l using an Unsupervised Segmentation Eusion 
algorithm. At each iteration t of the optimization algorithm, a new segmentation is computed. Specifically, 

K 

using the assumption that single element updates do not change the objective function Ht = Y d{si,st), 

i=l 

Ht is approximated by F[t_i with a scale parameter (3 € [0,1]. Then, the current best one element move is 
updated at t using 

d 

^st = + d{si>,st)) , 

OSt 

where s*/ is the randomly selected segmentation. If an V x U matrix [H] is defined such that the row 
and the column of the matrix, [H]nc, is the updated value of H obtained by switching element of 


s to the segment label, then the move ean be approximated by 

argmin (3[Ht-i\n,c + [d(si', St)]n,c , 


( 1 ) 


if Si' is seleeted for updating St at time t, = 1, 2,..., A^, Vc = 1, 2,..., C. If there is no improvement 
on the best move or a termination time T is aehieved, the eurrent segmentation is returned by the USF 
algorithm [fT4l . 

III. Incorporating Prior and Side Information to Segmentation Fusion 

In this seetion, we introduee a new Semi-supervised Segmentation Fusion algorithm whieh solves 
weighted deeision and distanee learning problems that are mentioned in Seetion |I] by ineorporating side- 
information about the pixel memberships into the unsupervised Segmentation Fusion algorithm. Then, the 
goal of the proposed Semi-supervised Segmentation Fusion algorithm ean be summarized as obtaining a 
segmentation whieh is elose to both base-layer segmentations and a target segmentation using weighted 
distanee learning and semi-supervision. 

In the weighted distanee learning problem, some of the weights may be required to be zero, in other 
words, sparsity may be required in the spaee of weight veetors to seleet the deeision of some of the 
segmentation algorithms. For instanee, if fusion is employed on multi-speetral images with large number 
of bands, and if some of the most informative bands are needed to be seleeted, then sparsity defined by 
the weight veetors beeomes a very important property. In addition, side information about the pixel-wise 
relationships of the segmentations ean be defined in distanee funetions. Thereby, both the strueture of the 
distanee funetion, the pixel-wise relationships and the contributions of the deeisions of the segmentation 
algorithms ean be learned from the data. 

A. Formalizing Semi-supervision for Segmentation Fusion 

We define Semi-supervised Segmentation Fusion problem as a eonvex eonstrained stoehastie sparse 
optimization problem. In the eonstruetion of the problem, first pixel-wise segment memberships are eneoded 
in the definition of a semi-supervised weighted distanee learning problem by deeomposing Symmetrie 
Distanee Funetion (SDD) as [fTSlI 


N N 


di^Si^Sj^ — dm,l(,^i ) '^7 ) 


( 2 ) 


m=l 1=1 


and 


1, if {m,l) € 0c(si) and {m,l) i 0c(sj) 


Sj) = j 1, if (m, 1) i 0c(si) and (m, 1) € 0^(5^) , 
0, otherwise 


where (m, 1) € 0c(si) means that the pixels m and I belong to the same segment 0c in Sj and (m, 1) i 0c(si) 
means that m and / belong to different segments in Sj. Then, a eonneetivity matrix M is defined with the 
following elements; 



( 3 ) 




Note that [flSll . 


( 4 ) 




Then, the distanee between the eonneetivity matriees of two segmentations s and Sj is defined as lf20l 

N N 

4(M(5),M(sO) = E , (5) 

m=l l=l 

where is the Bregman divergenee defined as 


d^(x,y) = k{x)- K{y)-Vn{y){x-y) , 

and K : M ^ M is a strietly eonvex funetion. Sinee d^ is defined in (Hj) as Euelidean distanee, ([5]) is eomputed 
during the eonstruetion of best one element moves. 

In order to eompute the weights of base-layer segmentations during the eomputation of distanee funetions, 
the following quadratie optimization problem is defined; 

K 

argmin Y,Wid^{M(s), M{si)) + \g || w ||| 

W 

K 

s.t.Y,Wi = l,Wi>0,di = l,2,...,K, ( 6 ) 

2=1 

where Ag > 0 is the regularization parameter and tv = (wi,W 2 , ■ ■ ■ ,wk) is the weight veetor. Sinee we use 

K 

'Zwi = l and tfij > 0 in the eonstraints of the optimization problem ®, we enable the selection and removal 

of a base-layer segmentation Sj by assigning re* = 0 to Sj. 

Defining the distanee funetion ([21) in terms of the segment memberships of the pixels dH) in dH), must-link 
and eannot-link eonstraints ean be ineorporated to the eonstraints of dS) as follows; 


Mml (■Si) 


11, if(m, /) € 271 

|o, if(m, 1) € € 


( 7 ) 


where 201 is the set of must-link eonstraints and € is the set of eannot-link eonstraints. Then, the following 
optimization problem is defined for Semi-supervised Segmentation Fusion 


K 

argmin E4(M(.),M(50) + Ag 

M{s) i=l 

s.t Mmz(sj) = l,if(m,/) e 971 

A7mz(si) = 0,if(m,/) e (t. (8) 


Wang, Wang and Li lf2^ analyze generalized eluster aggregation problem using dS]) for fixed weights w 
and define the solution set as follows; 

1) If {m,l) € 971 or (m,/) e £, then dl]) is the solution set for {k,l), 

2) If (m,/) i 971 and (m,/) i then Mmi{si) ean be solved by 

K 

2=1 

Then, they solve db]) for fixed M{s). Note that, (.2 norm regularization does not assure sparsity effieiently 
[fTSll beeause || tD II 2 is a quadratie funetion of the weight variables Wi whieh treats eaeh Wi equally. In 
order to eontrol the sparsity of the weights by treating eaeh Wi different from the other weight variables 


Wj^i using a linear function of Wi, such as || rc ||i which is the ii norm of w, a new optimization problem 
is defined as follows; 

K 

argmin M{si)) + X || w ||i 

{M{s),u)) i=l 

K 

s.t ^ tUj = 1, tUj > 0, Vi = 1,2,..., K 
2 = 1 

Mmi{si) = l,if(m,/) € m 

Mmz(si) = 0,if(m,0 e ^ , (9) 

where A e M is the parameter which defines the sparsity of w. Similarly, (|9l) is computed in two parts; 

1) For fixed M{s), solve 

K 

argmin Y,Wid^{M{s),M{si)) + X || w ||i 

W 

K 

S.t ^ tCj = 1, tUj > 0, Vi = 1,2,..., K . (10) 

2=1 

2) For fixed w, solve 

K 

argmin Y,Wid^{M{s), M{si)) + X || w ||i 

M{s) i=l 

s.t Mmz(si) = l,if(m,/) 6 ait 

= 0, if (m,/) e (T . (11) 

An algorithmic description of Semi-supervised Segmentation Fusion which solves (fTOl) and (fTTl) is given 
in the next subsection. 

B. Semi-supervised Segmentation Fusion Algorithm 

In the proposed Semi-supervised Segmentation Fusion algorithm, (fTOl) and (fTTl) are solved to compute 
weighted distance functions which are used in the construction of best one element moves. 

In Algorithm [H first the weight vector w is computed by solving (fT^ for each selected segmentation 
Sj/ in the 4*^ step of the algorithm. In order to solve (fTOl) using an optimization method called Alternating 
Direction Method of Multipliers (ADMM) O. ADMM has been employed to solve (fTOl) until a termination 
criterion r < or convergence is achieved Once the weight vector w is computed in the step, (fTTl) 
is solved in the 5^^, and 7*^ steps of the algorithm: wd{si>,s) -i- A || rD ||i is computed using M{si') 
and w in the 5*^ step, [i7t] is computed in the step and As is computed in the 7^^ step to update s. 
Note that the sparse weighted distance function, which is approximated by /3[i7t] + [ivd(si>,s) A || tD ||i] 
in Algorithm [H is different from the distance function in USF In addition, each segmentation is selected 
sequentially in a pseudo-randomized permutation order in Algorithm fH If an initially selected segmentation 
performs better than the other segmentations, then the algorithm may be terminated in the first running 
over the permutation set. Otherwise, the algorithm runs until the termination time T is achieved or all of 
the segmentations are selected. 


input : Input image I, T, Tr. 

output: Output segmentation O. 

1 Run SAj on I to obtain Sj = Vj = 1,2,..., J.; 

2 At i = 1, initialize s and 

for t 2 to T do 

3 Randomly seleet one of the segmentation results with an index z' e {1,2,..., AT}; 

4 Solve (fTO for M{si') to eompute Wk', 

5 Compute s) + A II fe 111; 

6 [Ht] l3[Ht\ + [wd{si>,s) + A II M) 111]; 

7 Compute As by solving argmin/5; 

n^c 

8 s ■«- s + As; 

9 f t + 1; 

end 

10 O ■«- s ; 

Algorithm 1: Semi-supervised Segmentation Fusion. 


IV. Experiments 

In this seetion, the proposed Semi-supervised Segmentation Fusion (SSSF) algorithm is analyzed on real 
world benehmark multi-speetral and aerial images |l2l, ifTSl . ll2Tll . In the implementations, three well-known 
segmentation algorithms, /c-means. Mean Shift eitems and Graph Cuts |[I1> llll> lEl are used as the base-layer 
segmentation algorithms. Three indiees are used to measure the performanees between the output images O 
and the ground truth of the images: i) Rand Index (RI), ii) Adjusted Rand Index (ARI), and iii) Adjusted 
Mutual Information {AMI) [fT^ which adjusts the effect of mutual information between segmentations due 
to chance, similar to the way the ARI corrects the RI. 

In the experiments, a Graph Cut implementation of Veksler [Q for image segmentation is used with 
a Matlab wrapper of Bagon [[U and the source code provided by Shi IfTTlI . The algorithm parameters 
are selected by first computing ARI values between a given target segmentation and each segmentation 
computed for each parameter Or e {0.1,0.2,..., 10}, cr^ € (1,2,..., 100}, Vncut ^ (1,2,..., 100} and Tncut ^ 
(0.01,0.02,..., 1} ifTTll . Then, a parameter 4-tuple {(TryCTs, Tncut, Tncut) which maximizes ARI is selecteclil 
Similarly, a parameter 3-tuple {hs,hr,mA) which maximizes ARI is selected for Mean Shift algorithm 
from the parameter sets hg e (1,3,5,10,50,100}, hr ^ {1, 3,5,10,50,100} and niA € (100,200 ..., 10000} 
fTlI . For A:-means, k = C is used, if not stated otherwise. Assuming that C is not known in the image, a 
parameter search algorithm proposed in ifTdll is employed using the training data in order to find the optimal 
C for c = 2,3,4,5,6,7,8,9,10. Similarly, the parameter estimation algorithm suggested in l[T4l is employed 
for a set of /3 values S = (0.1,0.2,0.3,0.4,0.5,0.6,0.7,0.8,0.9,0.99}. 

The termination parameter of SSSF and ADMM is taken as T = 1000 and Tr = 1000, respectively. 
The penalty parameter of ADMM is chosen as 6^ = 1 as suggested in [|3l. The regularization parameter is 
computed as A = S, where X^nax = max{\\dr,{M{s),M{sa))y\\2}a=v Vn = \\dn{M{s),M{sn))w\\2, 

S = is the set of segments in an training image and y = [?/i,?/ 2 ,... ,2/Ar] is the labels of segments 

in S. Then, A is computed in training phase and employed in both training and test phases. In the training 
phase, A and w are computed, and the constraints and C are constructed using the ground truth data, 
i.e. pixel labels of training images as described in Section IIII-Al In the testing phase, dH) is employed for 

'Minimization of ARI is considered as the cost function in the estimation of parameters following the relationship between ARI and SDD 
as well as it is one of the performance measures (H. 







the construction of connectivity matrices and [wd{sik,s) + A || w ||i] is computed Vz = The 

performance of the proposed SSSF is compared with the performances of /c-means, Mean Shift, Graph Cuts, 
Unsupervised Segmentation Fusion (USF) lfT4l . Distance Learning (DL) [[T4l and Quasi-distance Learning 
(QD) lfT4l algorithms. 

A. Analyses on Multi-spectral Images 

In the first set of experiments, the proposed algorithms are employed on 7 band Thematic Mapper Image 
(TMI) which is provided by MultiSpec The image with size 169 x 169 is split into training and test 
images: i) a subset of the pixels with coordinates x = (1 : 169) and y = {1 : 90) is taken as the training 
image and ii) a subset of the pixels with coordinates x = (1 : 169) and y = (91 : 142) is taken as the test 
image. Dataset is split in order to obtain segments with at least 100 pixels both in training and test images. 
In the images, there are (7 = 6 number of different segment labels. The distribution of pixels given the 
segment labels is shown in Fig. [TJ 




Segment Labels Segment Labels 

(a) Training dataset. (b) Test dataset. 

Fig. 1: Distribution of pixels given the segment labels in TMI. 


TABLE I: Training and test performances of the algorithms for Thematic Mapper Image. 


Average Base USF DL QD SSSF 



Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

RI 

0.730 

0.703 

0.731 

0.704 

0.738 

0.710 

0.732 

0.714 

0.792 

0.740 

ARI 

0.264 

0.159 

0.265 

0.160 

0.282 

0.184 

0.270 

0.174 

0.305 

0.220 

AMI 

0.182 

0.187 

0.182 

0.188 

0.205 

0.203 

0.198 

0.204 

0.251 

0.237 


First /c-means is implemented on different bands of the multi-spectral image I = ... ,Ij) for 

J = 7, in order to perform multi-modal data fusion of different spectral bands using segmentation fusion. 
The results of the experiments on Thematic Mapper Image is given in Table HI In the Average Base column, 
the performance values of A:-means algorithm averaged over 7 bands are given. It is observed that the 
performance values of USF are similar to the arithmetic average of the performance values of fc-means 
algorithms. When semi-supervision is used, a remarkable increase is observed in the performances in SSSF 
However, full performance (1 values for the indices) is not achieved in training. Since the output image O 
may not converge to the GT of the image, the convergence assumption mentioned in the previous section 
may not be valid for this image. 















TABLE II: Experiments on 7-band images. 


fc-means Graph Cut Mean Shift USF DL QD SSSF 



Tr 

Te 

R1 

0.742 

0.715 

ARI 

0.167 

0.125 

AMI 

0.176 

0.183 


Tr 

Te 

Tr 

0.754 

0.717 

0.710 

0.234 

0.132 

0.266 

0.193 

0.190 

0.195 


Te 

Tr 

Te 

0.714 

0.711 

0.714 

0.176 

0.267 

0.176 

0.209 

0.196 

0.209 


Tr 

Te 

Tr 

0.713 

0.710 

0.752 

0.270 

0.180 

0.262 

0.195 

0.205 

0.198 


Te 

Tr 

Te 

0.724 

0.801 

0.733 

0.178 

0.326 

0.236 

0.211 

0.220 

0.219 


In the second set of the experiments, A:-means, Graph Cut and Mean Shift algorithms are employed on 
7-band training and test images. Now, the image segmentation problem is considered as a pixel clustering 
problem in 7 dimensional spaces. The results are given in Table UIl The performance values of USE are 
closer to the performance values of the Mean Shift algorithm, since the output image of USE is closer to 
the output segmentation of the Mean Shift algorithm. Moreover, SSSE provides better performance than 
the other algorithms, since SSSE incorporate prior information by assigning higher weights to the partitions 
with higher performances. 




Segment Labels Segment Labels 

(a) Training dataset. (b) Test dataset. 

Eig. 2: Distribution of pixels given the segment labels in MDI. 


In the third set of experiments, fc-means algorithm is employed on each band of 12-band Moderate 
Dimension Image [|3. The size of the image is 949 x 220, and there are 11 segments in the GT of the 
image O. The classes are background. Alfalfa, Br Soil, Com, Oats, Red Cl, Rye, Soybeans, Water, Wheat, 
Wheat2. 104392 pixels are randomly selected for training and the remaining 104388 pixels are randomly 
selected for testing. In order to conserve the spatial distribution of the selected pixels, the pixels which 
reside in a segment with the same label in a spatial neighborhood are selected as test and training data. 
The distributions of pixels in training and test datasets are shown in Eig. |2l The results on the test data 
are given in Table |nll It is observed that the performance values for USE are smaller than the average 
performance values of base-layer segmentation outputs. When prior information is employed using SSSE, 
it is observed that the smaller weights are assigned to the segmentations with relatively small performance 
values. In addition, the output images of SSSE are closer to the target segmentations obtained from the GT 
images. In summary, remarkable performance increases are observed in SSSE algorithm. 











TABLE III: Performance of the algorithms for Moderate Dimension Image. 


Average Base USF DL QD SSSF 



Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

RI 

0.533 

0.532 

0.532 

0.530 

0.533 

0.533 

0.535 

0.530 

0.553 

0.550 

ARI 

0.008 

0.009 

0.007 

0.007 

0.013 

0.011 

0.010 

0.011 

0.109 

0.110 

AMI 

0.139 

0.141 

0.124 

0.120 

0.123 

0.121 

0.123 

0.124 

0.177 

0.185 


B. Analyses on Aerial Images 

In this section, the segmentation of roads in the aerial images is considered, which are analyzed in Il2n . 
Detailed information about the images in the dataset is given in IfTSlI . ll2T]| . 7 training and 7 test images with 
road and background labels are randomly selected from the dataset. The id numbers of the training and test 
images in the dataset are tr = {7,26,40,41,42,43,77}, and te = {78,90,91,92,93,94,95}, respectively. In 
order to observe the affect of the statistical similarity between training and test datasets, the performances 
are not averaged for different implementations of algorithms on random permutations of training and test 
images, and both of training and test performances are given in the results. 

The results are shown in Table |IVl It is observed that the performance indices of USF are the same as 
the indices of Mean Shift. This is basically because of the fact that Mean Shift has a higher number of 
different segment labels than the other algorithms. Therefore, the outputs of Mean Shift suppress the outputs 
of other algorithms in the computation of distance functions. Moreover, higher performances than the base- 
layer segmentation algorithms are obtained, when semi-supervision (SSSF) is employed in segmentation 
fusion. 


TABFE IV: Performances of algorithms on Road Segmentation Dataset. 



fc-means 

Graph Cut 

Mean Shift 

USF 

DL 

QD 

SSSF 


Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

Tr 

Te 

RI 

0.513 

0.535 

0.512 

0.523 

0.379 

0.328 

0.378 

0.328 

0.392 

0.353 

0.407 

0.390 

0.550 

0.563 

ARI 

0.014 

0.002 

0.017 

0.008 

0.010 

0.008 

0.010 

0.008 

0.010 

0.008 

0.011 

0.007 

0.020 

0.015 

AMI 

0.404 

0.003 

0.054 

0.006 

0.053 

0.070 

0.044 

0.070 

0.082 

0.080 

0.090 

0.080 

0.422 

0.110 


V. Conclusion 

An algorithm called Semi-supervised Segmentation Fusion (SSSF) is introduced for fusing the seg¬ 
mentation outputs (decisions) of base-layer segmentation algorithms by incorporating the prior information 
about the data statistics and side-information about the content into the Unsupervised Segmentation Fusion 
algorithm. The proposed SSSF algorithm reformulates the segmentation fusion problem as a constrained 
optimization problem, where the constraints are defined in such a way to semi-supervise the segmentation 
process. 

Experimental results show that the difference between RI and ARI values increases, as the number 
of segmentation outputs K increases for a fixed number of segments C. We observe that one of the 
reasons for the observation of this fluctuation is the early termination of the USF and the proposed SSSF 
before a consensus segmentation is obtained. In addition, the performances of the base-layer segmentation 
algorithms and the proposed segmentation fusion algorithms are sensitive to the statistical similarity of the 
images used in training and test datasets. The sensitivity of the base-layer segmentation algorithms affect 








the performances of the USF algorithm. Moreover, the employment of semi-supervision on the USF using 
Semi-supervised Segmentation Fusion algorithm further increase the performances. 

Note that the performances of the proposed algorithms can be improved by the theoretical analyses on 
their open problems such as the investigation and modeling the dependency of the performances on the 
algorithm parameters, the statistical properties of the segmentations and images in training and test datasets, 
which are postponed to the future work. 
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